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ABSTRACT 


The  Defense  University  Research  Instrument  Program  (DURIP)  grant,  Upgrade  of  the  Computing 
and  Visualization  System  for  DNS/LES  Research,  Grant  No.  F49620-00-1-0220  for  $400,000  has 
been  mainly  spent  for  upgrading  the  existing  SGI  Origin  2000  from  16  CPU  to  32  CPU  with 
additional  6  GB  memory  and  over  200  GB  hard  disk.  A  8  cpu  SGI  1200L  clustered  system  and 
a  number  of  SGI  and  Dell  Workstations  and  PCs  have  also  been  purchased  by  this  fund.  These 
purchases  and  upgrading  have  greatly  strengthen  Louisiana  Tech  University  in  conducting  Defense 
related  research  and  education.  Dr.  Liu’s  DNS/LES  group  has  got  permission  to  access  all  theses 
systems  to  conduct  their  state-of-the  art  DNS/LES  research  which  has  been  supported  by  AFOSR 
for  a  number  of  years.  They  have  used  that  system  to  conduct  DNS/LES  computation  for  3-D 
airfoils  and  plan  to  work  for  simplified  aircrafts. 
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List  of  Purchases 


32-4226-56131 

UPGRADE  OF  COMPUTING  &  VISUALIZATION  SYSTEM 


PR# 

Vendor 

Item 

Cost 

54  4537 

SGI 

Upgrade  SGI  Origin  2000 

SGI  Octane  2  V6  Graphics  Workstation 

8  SGI  1200L  Clustered  Dual  System 

338,979.55 

60  2801 

Rexel  Summers 

HBL2620  Hub 

24,23 

60  2847 

Murco 

Cutler  Hammer  Disconnect  Switch 

39.89 

60  2809 

Dell  Marketing 

4  PHI  Desktop  Workstations 

16,820.24 

59  4980 

Base  Distributors 

Tripplite  Smart  Datacenter  5000  HR  5KVA 
extended  runtime  LAN  UPS  system 

3,199.00 

61  7041 

Reimburse  Mel  Corley 

VMWare  Software  for  Windows  NT  &  2000 

99.00 

60  1500 

Reimburse  Carey  Cox 

VMWare  Software  for  Windows  NT  &  2000 

99.00 

60  4  583 

Reimburse  Mel  Corley 

VIA  Video  Conferencing  Software 

314.87 

61  7073 

Dell  Marketing 

4  Back-up  Pro 

716.00 

60  1493 

Portland  Group  Inc. 

Linux  Server  Software 

1,599.00 

61  6804 

Dell  Marketing 

Inspiron  8000,  Pentium  III,  Notebook  Computer 

3,358.95 

61  2625 

SGI 

3  18.2GB  Hard  Drives;  1  AMP  Power 

Distribution  Unit 

1,642.74 

61  2627 

Dell  Marketing 

3Com  SuperStack  3  Baseline  10/100  Switch 

24  port;  8  L^N  Utp  Cat  5  Patch  Cables;  OmniView 

Pro  16  Port  KVM  Switch  w/on-screen  display 

1,139.55 

61  2623 

Dell  Marketing 

Poweredge  1550 

12,246.56 

61  2622 

Dell  Marketing 

PowerVault  120T,  DLT1,  Desktop 

5  Black  Watch  DLT  IV 

4,123.90 

365.00 

61  2674 

Dell  Marketing 

2  1.50GHz,  P4,  DeilPrecision  330,  Mini  Towers 

9,890.52 

61  6801 

PC  Connection 

Ceiling  Mount  for  PowerUte  Projector; 

Epson  Poweriite  ELP-5350 

4,686.00 

61  2697 

XYZ  Scientific 

TrueGrid  Software 

500.00 

61  2675 

Dell  Marketing 

CD-RW  Drive 

156.00 

TOTAL 

400,000.00 
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2  Rationale  of  the  purchase 

2.1  Upgrade  of  the  SGI  Origin  2000  Computer 

Our  research  project,  Parallel  Multigrid  DNS/LES  Methods  for  Time-Dependent  Compressible  Tur¬ 
bulent  Flow  Around  3-D  Airfoils  (AFOSR  Grant  F49620-99-1-0042,  F49620-01-1-0065),  is  required 
to  solve  one  of  the  most  difficult  fluid  dynamics  problems  which  demands  utilization  of  thousands 
of  supercomputer  hours.  To  avoid  waiting  for  days  or  even  weeks  on  a  busy  CRAY  user’s  queue  and 
many  hours  for  huge  data  transfer  from  CRAY  to  our  local  computer  for  each  computational  job,  we 
purchased  an  SGI  Origin  2000  with  16  CPUs  and  4  GB  memory  by  a  AFOSR  grant  and  Louisiana 
Tech  matching  fund  in  July  1998  at  a  total  cost  of  $300,000.  This  SGI  parallel  computer  has  greatly 
increased  our  computational  capability  and  dramatically  accelerated  our  research.  However,  as  the 
research  steps  up  to  the  stage  of  DNS/LES  for  3-D  airfoils  and  wing- fuselage  combination,  we  have 
to  use  much  more  grid  points  which  requires  huge  memory  and  CPU  time.  By  this  DURIP  grant, 
we  have  upgraded  our  system  by  increasing  additional  6  GB  memory  and  16  processors.  We  also 
increased  additional  227  GB  hard  disk  for  our  huge  DNS/LES  data  base  and  visualization.  This 
upgrade  enable  us  to  have  10  GB  memory,  300  GB  hard  disk  and  32  processors  on  the  SGI  Origin 
2000  system  which  will  be  able  to  handle  3-D  time-dependent  problems  with  more  than  30  million 
grid  points.  It  is  critical  to  the  success  of  our  AFOSR  research  project. 

SGI  Origin  2000  is  an  advanced  shared  memory  machine  with  CRAY  linkage  technology  which 
is  scalable  for  large  number  of  processors.  SGI  also  has  a  so-called  VARSITY  program  which 
can  provide  half-million  dollar  software  package  including  Fortran  90,  C++,  and  MPI  to  users  for 
an  annual  cost  of  three  thousand  dollars.  In  addition,  SGI  has  a  nice  reputation  for  its  graphic 
technology. 

We  also  purchased  SGI  Cluster  with  8  CPUs  and  a  number  of  SGI  and  Dell  Workstations  and 
PCs  to  support  the  system  and  provide  students  and  researchers  to  conduct  defense  related  research 
and  education. 

2.2  Impact  on  the  DNS/LES  Research  Project 

The  Center  for  Numerical  Simulation  and  Modeling  (CNSM)  which  is  previously  called  Numerical 
Simulation  Group  led  by  Dr.  Chaoqun  Liu,  has  a  long  history  working  on  DNS/LES  for  complex 
turbulent  flow.  Since  it  moved  to  Louisiana  Tech  University  in  1996,  CNSM  has  formed  a  DNS/LES 
team  which  consists  of  faculty,  post  doctors  and  PhD  students  with  expertise  in  grid  generation, 
numerical  scheme,  flow  solver,  turbulence  modeling,  and  visualization  under  AFOSR  support.  The 
University  has  provided  $120,000  for  purchase  of  equipment  and  around  4000  square  feet  space  with 
air  condition  and  technical  support  to  house  the  research  group  and  equipment.  Now,  CNSM  has 
become  one  of  the  major  DNS/LES  research  groups  around  the  nation  and  a  major  computational 
research  center  in  the  University.  Dr.  Liu’s  group  has  moved  to  UT-Arlington,  but  got  permission 
from  La  Tech  to  access  all  these  computing  and  visualization  systems  for  their  AFOSR  research 
project. 

With  this  grant  we  are  able  to  have  32  processors,  10  GB  memory,  and  300  GB  hard  disk  drive 
which  has  doubled  our  capability  to  conduct  DNS/LES  for  more  complex  geometry  and  higher 
Reynolds  number.  The  quality  of  research  and  education  will  be  significantly  improved. 
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2.3  Impact  on  Research  Related  Education 

The  interdisciplinary  PhD  curriculum,  the  Mathematics,  and  the  Computer  Science  MS  program 
at  Louisiana  Tech  University  include  several  courses  related  to  computation.  These  courses  are 
designed  to  meet  the  dramatically  growing  demand  for  expertise  in  parallel  computation  by  the 
industrial  market.  With  this  upgrading,  CNSM  now  can  provide  these  students  more  opportunities 
to  practice  the  parallel  computing  techniques.  High-performance  C++,  C,  and  Fortran  compilers 
have  already  been  installed,  as  well  as  the  Message  Passing  Interface  (MPI)  package.  The  virtual 
reality  system  which  was  purchased  by  a  Louisiana  State  grant  and  supported  by  the  SGI  system  can 
also  be  used  as  a  means  to  assistant  these  students  to  improve  their  ability  to  conduct  visualization 
and  data  analysis.  The  upgrade  of  this  SGI  computer  has  attracted  more  graduate  students  to 
work  for  future  DoD-sponsored  programs  and  significantly  enhance  the  capability  of  Louisiana 
Tech  University  to  conduct  DoD  research-related  education. 

This  project  also  gives  a  significant  impact  on  faculty  development.  In  general,  the  quality  of 
faculty  determines  the  quality  of  research.  This  will  significantly  improve  the  level  of  computational 
facilities  available  to  the  faculty,  thereby  permitting  CNSM  to  attract  and  retain  better  faculty  and 
post  doctors.  Existing  faculty  can  achieve  computational  results  at  levels  not  otherwise  possible, 
thereby  enhancing  career  advancement  and  improving  the  quality  of  research  and  education. 


2.4  Impact  on  the  DNS/LES  Community 

CNSM  has  hosted  the  First  AFOSR  International  Conference  on  DNS/LES  in  1997  which  attracted 
93  participants  from  16  countries  around  the  world.  The  AICDL  conference  is  a  major  conference  in 
the  world  which  is  focused  on  DNS/LES.  CNSM  will  organize  the  Third  AFOSR  International  Con¬ 
ference  on  DNS/LES  in  August  2001,  which  means  CNSM  will  organize  this  important  DNS/LES 
conference  twice  within  four  years.  CNSM  has  been  recognized  as  a  notable  DNS/LES  research 
center  by  the  world  DNS/LES  community. 

The  success  of  the  AFOSR  project  will  clearly  show  the  global  DNS/LES  community  that 

US  is  leading  the  world  in  DNS/LES  research  and  pushing  DNS/LES  for  practical  engineering 
applications. 

,  The  DURIP  grant  has  played  an  important  role  to  the  success  of  our  AFOSR  DNS /LES  research 
project,  the  DoD  project  related  education,  and  the  US  reputation  of  leading  the  world  in  basic 
research  on  turbulence. 


3  Current  AFOSR  Research  Project 


We  currently  conduct  AFOSR  research  project,  Numerical  Simulation  of  Flow  Instability  around 
a  Delta  Wing. 

Recent  developments  in  aerospace  technology  have  revived  the  interest  to  the  study  of  flow 
separations  around  an  aircraft  maneuvering  dynamic  operations.  Understanding  of  the  complex 
separated  vortical  flow  is  crucial  to  the  aerodynamic  design  of  modern  aircraft.  Vortical  structures, 
which  develop  over  the  leading-edge  extension,  slender  fore-body,  and  main  wing,  may  have  severe 
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effect  on  the  aerodynamic  characteristics  and  performance  of  modern  fighter  aircraft. 

A  flat-plate  delta  wing  with  sharp  leading-edge  provides  a  simple  configuration  to  investigate 
the  development  of  the  vortical  structures.  Both  experimental  and  computational  results  have 
shown  that  the  flow  over  the  suction  side  of  a  delta  wing  at  a  fixed  angle  of  attack  is  dominated 
by  a  pair  of  counter-rotating  vortices,  i.e.  the  leading-edge  primary  vortices.  These  vortices  are 
formed  as  a  result  of  the  rolling-up  of  the  vortex  sheet  shedding  from  the  leading-edge.  The  flow 
induced  by  the  leading-edge  vortices  separates  near  the  wing  surface  and  forms  a  pair  of  oppositely 
rotating  secondary  vortices.  The  size  and  strength  of  the  leading-edge  vortices  increase  with  the 
angle  of  incidence,  resulting  in  a  substantial  nonlinear  lift  increment.  But  the  maximum  lift  of  a 
delta  wing  is  limited  by  a  phenomenon  known  as  vortex  breakdown(Visser  &  Nelson  1993). 

In  the  experimental  study  using  dye  visualization  carried  out  by  Gad-el-Hak  and  Balckwelder 
(1985),  small-scale  vortices  were  observed  shedding  from  the  leading-edge  and  feeding  into  the 
rolling-up  process  associated  with  the  large-scale  leading-edge  vortices.  In  their  study,  the  small- 
scale  vortices  were  paired,  and  were  believed  as  the  origination  of  the  classical  leading-edge  vortices. 
Payne  et  al.  (1988)  used  smoke  flow  visualization  and  laser  sheet  technique  to  study  the  vortical 
flow  field  above  the  delta  wing  at  high  angles  of  attack.  Two  types  of  vortex  breakdown  were 
testified,  i.e.  the  bubble  mode  and  the  spiral  mode.  In  the  same  experiment,  static  small-scale 
vortical-like  structures  were  found  in  the  shear  layer  of  a  delta  wing  with  a  85°  sweep  angle  and 
a  40°  angle  of  attack.  The  growth  of  these  structures  was  found  to  be  similar  to  the  evolution  of 
the  classic  Kelvin-Helmholtz  instability.  In  this  experiment,  the  pairing  of  the  small-scale  vortices 
was  not  observed.  The  recent  experimental  work  of  Rieley  &  Lowson  (1998)  revealed,  using  flow 
visualization  and  hot-wire  measurement,  the  existence  of  static  small  vortical  structures  in  the 
free  shear  layer  shedding  from  the  sharp  leading-edge  of  a  delta  wing.  A  local  three-dimensional 
Kelvin- Helmholtz-type  instability  was  suggested  by  the  authors  for  the  formation  of  these  vortical 
structures  in  the  free  shear  layer.  Similar  vortical  structures  were  also  observed  in  the  investigations 
of  Cipolla  &  Rockwell  (1998),  where  small-scale  concentrations  of  vorticity  form  near  the  leading- 
edge  of  a  rolling  delta  wing.  These  vortices  appear  to  evolve  in  a  coupled  fashion,  which  has  been 
considered  as  the  wake-like  instability. 

Numerical  simulations  of  vortex  breakdown  above  a  stationary  sharp  edged  delta  wing  over 
a  range  of  angles  of  attack  were  carried  out  by  Modiano  &  Murman  (1994).  Their  computation 
was  based  on  an  Euler  solver  with  adaptive  mesh  system.  The  spiral  form  of  vortex  breakdown 
»  was  observed  without  the  emergence  of  the  small-scale  vortical  structures  inside  the  shear  layer. 
In  the  numerical  investigation  by  Argwal  et  al.  (1992),  the  well-known  Euler/Navier-Stokes  code 
CFL3D  was  used  to  simulate  the  leading-edge  vortex  breakdown  of  a  low-speed  flow  on  a  flat-plate 
delta  wing  with  sharp  leading-edges.  Although  the  vortex  breakdown  positions  obtained  from  the 
computation  were  reported  in  good  agreement  with  experimental  data,  the  small-scale  vortices  were 
not  observed,  which  could  be  attributed  to  the  lack  of  numerical  resolution/accuracy.  A  numerical 
investigation  of  the  unsteady  vortex  structure  over  a  76°  sweep  wing  at  20.5°  angle  of  attack  was 
carried  out  by  Gordnier  &;  Visbal  (1994).  Their  numerical  calculation  indicated  that  the  small-scale 
vortical  structures  emanated  from  the  leading-edge  was  brought  on  by  the  Kelvin-Helmholtz-type 
instability.  Pairing  of  the  small  vortices  was  not  observed  in  the  computational  results. 

The  intention  of  present  work  is  to  study  the  mechanism  of  vortex  breakdown  above  a  slender 
flat-plate  delta  wing  with  sharp  leading-edges  at  a  fixed  angle  of  attack.  Direct  numerical  simulation 
is  employed  to  give  a  detailed  description  of  flow  instability  and  vortex  shedding  near  the  leading- 
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edge  of  the  delta  wing. 


3.1  Governing  Equations 


The  three-dimensional  compressible  Navier-Stokes  equations  in  generalized  curvilinear  coordinates 
(£,77,  C)  are  written  in  conservative  forms: 


Jdt 

The  flux  vectors  for  compressible  flow  are 


ldQ  ,  d(E-Ev)  ,  d(F-Fv)  ,  d(G-Gv) 
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(  0 
1  Txx^x  4*  TyxCy  4*  7 zxCz 

Gy  —  ~J  TXyCx  4*  ryyCy  4~  TzyCz 

7x2 Cx  4~  TyzCy  TzzCz 

\  9xCx  +  9yCy  +  qzCz 

where  J  is  Jacobian  of  the  coordinate  transformation,  and  ^x^y^z.Vx.Vy^VzXxXyXz  are  coordi¬ 
nate  transformation  metrics,  r^i  s  and  qk's  are  the  viscous  stress  and  the  heat  flux,  respectively. 

In  Eq.  (1),  second  order  Euler  Backward  scheme  is  used  for  time  derivatives,  and  the  fully 
implicit  form  of  the  discretized  equations  is: 


3 Qn+1  -  4 Qn  +  Qn~l  5(En+1  -  ££+1) 
2JAt  + 

d(Fn+1  -  F™+1)  d(Gn+1  -  G£+1) 

Y  Cl  rTZ  - 


Qn+l  is  estimated  iteratively  as: 
where, 


Qn+l  =  QP  +  SQP 

SQP  =  Qp+1  -  QP 


(2) 

(3) 

(4) 


At  step  p  —  0,  Qp  —  Qn]  as  6QP  is  driven  to  zero,  Qp  approaches  Qn+l.  Flux  vectors  are  linearized 
as  follows: 


En+1  ~  Ep  +  Ap6QP 

pn+l  ~FP  +  BPSQP  '  (5) 

Gn+ 1  «  Gp  +  CP6QP 

So  that  Eq.  (2)  can  be  written  as: 

[7^1  +  AtJ(D^A  +  DVB  +  D^C)]SQP  =  R  (6) 

,  where  R  is  the  residual: 

R  =  -{\QV-2Qn+l-Qn-x)-AtJ{{D^E-Ev) 

,  +  DV{F -FV)+D^G-GV)]P 


D^,Dp,DQ  represent  partial  differential  operators,  and  A,  B,  C  are  the  Jacobian  matrices  of  flux 
vectors: 


=  dE  dF  dG 

dQ'  n  d  Q'  dQ 


(7) 


The  right  hand  side  of  Eq.  (6)  is  discretized  using  fourth-order  compact  scheme  (Lele,  1992)  for 
spatial  derivatives,  and  the  left  hand  side  of  the  equation  is  discretized  following  LU-SGS  method 
(Yoon  &  Kwak,  1992).  In  this  method,  the  Jacobian  matrices  of  flux  vectors  are  split  as: 


A  =  A+  +  A~,  B  =  B+  +  B~,  C  =  C+  +  C~ 
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where 


A±  =  \{a±taI} 

B±  =  \[B±rBI]  (8) 

C*  =  \[C±rcI) 

and, 

=  Kmax[|A(A)|]  +  v 
rB  =  K,max[\X(B)\]  +  u 
rc  —  K,max[\\(C)\ ]  +  v 

where  A(A),  A (B),  A (C)  are  eigenvalues  of  A,B,  C  respectively,  k  is  a  constant  greater  than  1.  u  is 
taken  into  account  for  the  effects  of  viscous  terms,  and  the  following  expression  is  used: 

r  ^  4  A*  i 

v  =  maxi- - — — — ,  -  — 

l(Y  -  l)M?RePr  3  Re 

The  first-order  upwind  finite  difference  scheme  is  used  for  the  split  flux  terms  in  the  left  hand 
side  of  Eq.  (6).  This  does  not  effect  the  accuracy  of  the  scheme.  As  the  left  hand  side  is  driven  to 
zero,  the  discretization  error  will  also  be  driven  to  zero.  The  finite  difference  representation  of  Eq. 
(6)  can  be  written  as: 

[\l  +  MJ(rA+rB+rc)I]6Q^k  = 

-AfJ  [  A-SQl1J:l-A+6Ql1Jit 

+ 

+  -  c+s%J*-i  1  M 

In  LU-SGS  scheme,  Eq.  (9)  is  solved  by  three  steps.  First  initialize  5Q°  using 

=  [\l  +  A«(r 'A  +  rB  +  rc)I]-lRljt 
In  the  second  step,  the  following  relation  is  used: 

SQijjc  =  SQhk  +  [\l  +  A  tJ(rA  +rB  +  TC)I}-1 
x[AtJ(A+5QUj,k  +  B+SQtj^k  +  C+5QPk_x)] 

For  the  last  step,  8QP  is  obtained  by 

SQlj,k  =  iQhi  -  [|r  +  AiJ(r4  +  TB  +  rc)]-1 

x[A  tJ(A-5Qri+hjk  +  B-6Q’ij+u  +  CSQ^  t+,)] 

The  sweeping  is  performed  along  the  planes  of  i+j  +  k  =  const ,  i.e.  in  the  second  step,  sweeping 
is  from  the  low-left  corner  of  the  grid  to  the  high-right  corner,  and  then  vice  versa  in  the  third  step. 
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In  order  to  depress  numerical  oscillation  caused  by  central  difference  scheme,  spatial  filtering  is 
used  instead  of  artificial  dissipation.  Implicit  sixth-order  compact  scheme  for  space  filtering  (Lele, 
1992)  is  applied  for  primitive  variables  u,u,u/,p,p  after  each  time  step. 

For  subsonic  flow,  u,v,w,T  are  prescribed  at  the  inflow  boundary,  p  is  obtained  by  solving 
modified  N-S  equation  based  on  the  characteristic  analysis.  On  the  far  field  and  out  flow  boundary, 
non-reflecting  boundary  conditions  are  applied.  Adiabatic,  non-slipping  conditions  are  used  for  the 
wall  boundary.  All  equations  of  boundary  conditions  are  solved  implicitly  with  internal  points. 
Specific  details  of  boundary  treatment  can  be  found  in  Jiang  et  al  (1999). 

3.2  Computational  Details 

Direct  numerical  simulation  has  been  implemented  to  investigate  the  compressible  flow  separation 
around  a  slender  delta  wing.  The  geometry  of  the  delta  wing,  taken  from  the  experimental  work 
of  Rieley  &  Lowson  (1998),  is  shown  in  Figure  1.  The  sweep  angle  denoted  by  A  is  80°  and  the 
leading-edge  angle  denoted  by  a  is  30°.  The  chord  length  is  taken  as  the  characteristic  length  L, 
such  that  the  non-dimensional  chord  length  is  c  =  1.0L.  The  non-dimensional  thickness  of  the  delta 
wing  is  h  —  0.024 L.  The  freestream  velocity  Uoq  is  the  characteristic  velocity. 


c_ 


L 

h 

T 


B 


A 


A  I 

i 

c _ B 


A-A  B-B  /\<* 

Figure  1:  Schematic  of  the  delta  wing 

An  H-C  type  mesh  system  for  a  half-plane  model  of  the  delta  wing  is  used  based  on  the  as¬ 
sumption  that  the  flow  is  symmetrical  to  the  the  half-plane.  The  mesh  is  H-type  in  the  meridian 
section  and  C-type  in  the  cross  section.  An  elliptic  grid  generation  method,  first  proposed  by 
Spekreijse  (1995),  is  used  to  generate  the  three-dimensional  grids.  This  method  is  based  on  a 
composite  mapping,  which  is  consisted  of  a  nonlinear  transfinite  algebraic  transformation  and  an 
elliptic  transformation.  The  grids  are  orthogonal  on  the  delta  wing  surface.  The  sharp  leading-edge 
is  approximated  by  a  round  edge  with  a  small  radius  of  1.0  x  10~3L,  while  in  the  experiment  of 
Rieley  &  Lowson  (1998),  the  average  thickness  of  the  leading-edge  was  0.12  mm,  which  was  approx¬ 
imately  2.55  x  10 ~aL.  Computations  are  carried  out  on  two  grid  systems,  i.e.  the  low  resolution 
mesh  with  140  x  70  x  70  grid  nodes  and  the  high  resolution  mesh  with  180  x  150  x  70  grid  nodes, 
where  the  sequence  of  numbers  is  corresponding  to  the  axial,  the  spanwise  and  the  wall-normal 
direction,  respectively.  An  example  of  the  three-dimensional  grid  is  displayed  in  Figure  2. 

The  parallel  version  of  the  DNS  code  based  on  the  Message  Passing  Interface  (MPI)  has  been 
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Figure  2:  H-C  type  grid  around  a  85°  sweep  delta  wing 


developed  to  accelerate  the  computation.  Although  massive  data  exchanges  are  required  for  com¬ 
puting  the  derivatives  with  the  compact  finite  difference  scheme,  the  speedup  is  still  substantial. 
On  a  SGI  Origin  2000  computer,  the  performance  of  the  MPI  code  is  superior  to  the  serial  code, 
which  is  compiled  using  the.  automatic  parallelization  option  provided  by  Fortran  90  compiler.  The 
comparison  are  displayed  in  Figure  3,  where  the  speedup  parameter  S(n,p)  is  defined  as  the  ratio 
of  the  runtime  of  a  serial  solution  to  a  problem  to  the  parallel  runtime.  Linear  speedup  has  been 
achieved  for  MPI  code  running  on  4,  6,  and  15  processors.  The  final  parallel  computation  for  the 
higher  Reynolds  number  case  with  a  mesh  of  180  x  150  x  70  is  conducted  using  10  processors  on  a 
SGI  Origin  2000  computer. 


Figure  3:  Speedup  S(n,p)  of  the  MPI  code  compared  with  the  serial  code  complied  with  automatic 
parallelization  option 


3.3  Results  and  Discussions 


3.3.1  Low  Reynolds  number  case 

All  results  presented  here  are  obtained  from  direct  numerical  simulation  of  flow  around  a  85° 
sweep  delta  wing  with  a  flat-plate  suction  surface,  which  has  been  introduced  in  Section  3.  The 
angle  of  attack  is  fixed  at  12.5°.  The  free-stream  Mach  number  is  Ma  =  0.1.  For  the  lower 
resolution  simulation,  the  Reynolds  number  based  on  the  chord  length  and  the  free-stream  velocity 
is  Rec  =  5  x  104.  No  initial  and  boundary  disturbance  are  imposed  in  the  simulation. 

The  contours  of  the  axial  vorticity  on  selected  cross  sections  are  displayed  in  Figure  4.  It  is 
quite  clear  that  a  pair  of  counter-rotating  vortices,  so  called  the  leading-edge  primary  vortices, 
appears  over  the  suction  side  of  the  delta  wing.  These  vortices  form  as  a  result  of  flow  separation 
and  the  rolling-up  of  the  vortex  sheet  shedding  from  the  leading-edge.  The  primary  vortices  are 
steady  and  stable  in  this  low  Reynolds  number  case.  The  primary  vortices  are  composed  of  a 
pair  of  counter-rotating  oblique  vortex  tubes  starting  from  the  apex  of  delta  wing,  from  a  three- 
dimensional  point  of  view.  Beneath  the  primary  vortices,  near  the  upper  surface  of  the  delta 
wing,  the  secondary  vortices,  which  have  an  opposite  rotating  direction  to  the  primary  vortices,  are 
formed  as  a  result  of  the  spanwise  outflow  induced  by  the  primary  vortex.  Figure  5  shows  the  three- 
dimensional  instantaneous  streamlines  starting  from  vicinity  of  the  leading-edge.  The  streamlines 
also  reveals  the  existence  of  the  cone-shaped  primary  vortices.  The  computational  results  are  in 
good  agreement  with  the  experimental  results  of  Riley  &  Lowson  (1998).  During  the  computation 
for  the  high  Reynolds  number  case,  the  flow  becomes  unsteady  and  small-scale  vortical  structures 
keep  shedding  from  the  leading-edge.  In  the  experiment  of  Riley  &  Lowson  (1998),  flow  instability 
was  observed  when  the  Reynolds  number  was  raised  above  Rec  =  100, 000.  In  order  to  study  the 
flow  instability  near  the  leading  edge,  the  numerical  simulation  with  a  higher  resolution  and  higer 
Reynolds  number  has  been  implemented,  and  the  results  are  discussed  in  next  section. 


Figure  4:  Contours  of  the  axial  vorticity 
on  selected  cross  sections,  angle  of  attack 
a  =  12.5°,  Re  =  5  x  104,  Ma  =  0.1 


Figure  5:  Three-dimensional  streamline 
above  the  suction  surface  of  a  85°  sweep 
delta  wing  at  an  angle  of  attack  a  =  12.5°, 
Re  =  5  x  104,  Ma  =  0.1 
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3.3.2  High  Reynolds  number  case 

At  higher  Reynolds  number,  i.e.  Rec  —  1.96  x  105,  which  is  the  same  as  the  one  chosen  by  Riley  & 
Lowson  (1998)  in  their  experimental  study,  where  the  flow  instability  occurs  near  the  leading  edge 
of  the  delta  wing.  In  order  to  capture  the  small  vortical  structures  observed  in  the  experiment,  the 
numerical  simulation  is  accomplished  on  a  mesh  with  a  higher  resolution  of  180  x  150  x  70.  During 
the  simulation,  flow  instability  and  periodic  shedding  of  small  vortical  structures  are  observed. 
Since  there  is  no  disturbance  imposed  as  the  initial  or  boundary  condition  for  the  computation,  the 
unstable  behavior  presented  by  the  flow  in  the  computational  results  are  rather  intrinsic. 

The  distributions  of  the  instantaneous  axial  vorticity  on  various  cross  sections  are  shown  in 
Figure  6.  Compared  with  the  low  Reynolds  number  results  of  Figure  4,  the  flow  is  still  dominated 
by  a  pair  of  primary  vortices.  But  instability  appears  at  the  leading-edge  of  delta  wing,  where 
vortex  shedding  is  observed.  On  the  suction  surface  near  the  leading-edge,  the  secondary  vortices 
are  still  visible  in  this  figure. 


Figure  6:  The  instantaneous  distributions  of  the  axial  vorticity  on  various  cross  sections.  Angle  of 
attack  a  -  12.5°,  Re  =  1.96  x  105,  Ma  =  0.1 


In  Figure  7  the  contours  of  axial  vorticity  at  different  time  on  a  cross  section  at  x  —  0.87 L  are 
displayed  through  (a)  to  (h),  each  frame  is  corresponding  to  a  snapshot  of  a  two-dimensional  flow 
field  at  a  certain  time.  Flow  instability  is  quite  obvious  in  these  figures.  The  primary  vortex  deforms 
,  compared  to  the  low  Reynolds  number  case.  The  flow  pattern  inside  the  primary  vortex  resembles 
that  of  the  spiral  instability  mode,  which  presented  occasionally  in  the  experiment  of  Rieley  &; 
Lowson(1998).  Two  strong  shear  layers  are  visible  through  the  concentration  of  axial  vorticity 
contours.  The  first  one  is  the  leading-edge  shear  layer  whose  axial  vorticity  is  positive  (shown  in 
light  color  in  Figure  7),  which  wraps  the  leading-edge  corner  from  below  and  feeds  into  the  primary 
vortex.  The  other  one  lies  between  the  primary  vortex  and  the  upper  surface  of  the  delta  wing 
and  has  a  negative  axial  vorticity  (shown  in  dark  color  in  Figure  7),  which  is  associated  with  the 
secondary  vortex.  Therefore,  the  shear  layer  below  the  primary  vortex  is  also  called  the  secondary 
shear  layer.  As  it  will  be  discussed  later,  both  the  leading-edge  shear  layer  and  the  secondary  shear 
layers  are  related  to  the  instability  and  vortex  shedding  procedure  near  the  leading-edge. 

Among  the  small-scale  vortical  structures  shedding  from  the  leading-edge,  there  are  two  types  of 
vortices,  distinguished  by  the  direction  of  rotation  or  by  the  sign  of  axial  vorticity.  Those  vortices 
whose  rotating  direction  is  the  same  as  the  primary  vortex  are  named  as  the  A-family  vortices, 
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which  are  corresponding  to  a  positive  axial  vorticity  component.  The  vortices  rotating  in  the 
opposite  direction  as  the  primary  vortex  are  called  the  B-family  vortices  and  have  a  negative  axial 
vorticity  component.  The  A-family  vortices  are  much  stronger  than  the  B-family  vortices,  which 
can  be  recognized  from  the  contours  of  the  axial  vorticity  in  Figure  7. 

In  Figure  7(a),  a  bulge  is  observed  on  the  leading-edge  shear  layer.  The  bulge  grows  in  size 
as  it  moves  away  from  the  leading  edge,  as  shown  in  Figure  7(b),  (c),  and  (d).  This  process 
is  corresponding  to  the  generation  and  shedding  of  the  A-family  vortex.  Because  the  B-family 
vortices  are  very  weak,  the  shedding  process  of  B-family  vortices  is  not  clear  in  Figure  7.  A  more 
detailed  study  reveals  that  the  B-family  vortex  comes  from  the  shedding  of  the  secondary  vortex. 

In  Figure  7,  frame  (a)  resembles  frame  (g).  So  frames  (a)  through  (g)  show  one  period  of  vortex 
shedding.  The  small-scale  vortical  structures  shedding  from  the  leading-edge  are  in  turn  captured  by 
the  primary  vortex  and  feeding  into  the  rolling-up  process  of  the  primary  vortex.  After  leaving  the 
leading-edge,  both  A-  and  B-family  vortices  experience  severe  deformation  as  they  are  stretched  and 
captured  by  the  primary  vortex.  The  flow  pattern  inside  the  core  of  the  primary  vortex  resembles 
that  of  the  spiral  instability  mode,  which  is  also  observed  in  the  experiment  (Rieley  &  Lowson, 
1998).  In  the  numerical  simulation,  these  small-scale  vortical  structures  dissipate  quickly  as  they 
are  leaving  the  leading-edge  and  entering  the  central  region  of  the  primary  vortex.  But  in  the 
experiment  the  spiral  instability  can  evolve  into  transition.  The  fast  dissipation  of  the  spiral  mode 
in  the  numerical  simulation  can  be  attributed  to  the  insufficiency  of  resolution.  Because  grids  are 
clustered  near  the  wall  and  near  the  leading-edge  of  delta  wing,  in  the  areas  far  away  from  the  wall 
the  resolution  is  relatively  low.  The  future  effort  will  be  devoted  to  increasing  the  resolution  where 
the  primary  vortex  locates. 

Because  the  small-scale  vortical  structures  are  shedding  continuously  from  the  leading-edge, 
the  area  near  the  leading-edge  is  of  particular  interesting  in  present  work.  The  detailed  pictures 
of  vortex-shedding  near  the  leading-edge  is  shown  in  Figure  8,  where  the  limiting  streamline  and 
contours  of  axial  vorticity  of  various  instance  on  a  cross-section  at  x  =  0.87L  are  displayed.  Through 
(a)  to  (h)  in  Figure  8,  the  pattern  of  limiting  streamline  exhibits  a  periodic  feature.  Actually,  figures 
(a)  to  (g)  fit  in  one  period  of  variation.  In  Figure  8(a),  there  is  a  secondary  vortex  attaching  on 
the  upper  surface  of  delta  wing.  The  strong  leading-edge  shear  layer  is  shown  by  dark  color  of 
the  contours  of  axial  vorticity.  Near  the  leading-edge,  the  shear  layer  is  concentrated  in  a  narrow 
area.  In  Figure  8(b),  at  t  =  55.68L/UQO)  a  small  vortex  shown  by  the  limiting  streamline  appears 
'  near  the  leading-edge  over  the  free  shear  layer.  In  the  same  picture,  a  small  bulge  appears  on 
the  shear  layer.  The  generation  of  this  small  vortex  can  be  attributed  to  the  Kelvin-Helmholtz 
instability.  Therefore,  the  small  vortex  is  named  as  the  Kelvin-Helmholtz  (K-H)  type  vortex.  At 
the  same  time,  the  secondary  vortex,  which  was  attaching  on  the  wing  surface  at  t  —  55.54£/i7oo, 
moves  away  from  the  wall.  As  the  K-H  type  vortex  grows,  the  secondary  vortex  is  pushed  further 
away  from  the  wall.  From  t  =  55.81L/J7oo  to  t  —  55.95T/C/oo,  (Figure  8(c)  to  (d))  the  secondary 
vortex  moves  upward  and  begins  to  separate  from  the  wall,  which  is  corresponding  to  the  B-family 
vortex,  whose  rotating  direction  is  opposite  to  the  primary  vortex.  Therefore,  the  B-family  vortex 
comes  from  the  shedding  of  the  secondary  vortex.  The  generation  of  the  leading-edge  K-H  type 
vortex  also  causes  the  deformation  of  the  shear  layer,  which  is  visible  from  the  contours  of  the  axial 
vorticity  in  Figure  8(b),  (c),  and  (d).  The  bulge  on  the  contours  of  axial  vorticity  is  corresponding 
to  the  K-H  type  vortex.  In  Figure  8(d),  the  secondary  vortex  almost  disappears  and  the  K-H  type 
vortex  is  still  attached  to  the  leading-edge.  In  Figure  8(e)  and  (f),  the  K-H  type  vortex  grows  in 
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size  until  it  reaches  the  edge  of  the  primary  vortex.  Another  vortex  appears  at  the  same  location  of 
the  secondary  vortex,  actually  it  is  a  new  secondary  vortex.  The  K-H  type  vortex  gradually  moves 
upward  and  sheds  from  the  leading-edge,  and  comes  out  to  be  the  A-family  vortex,  whose  rotating 
direction  is  the  same  as  the  primary  vortex.  It  is  obviously  that  the  A-family  vortex  originates 
from  the  K-H  type  leading-edge  vortex.  The  last  two  frames  are  the  periodic  repeating  of  frames 
(a)  and  (b)  in  Figure  8. 

The  vortex-shedding  near  the  leading-edge  is  a  periodic  process.  The  interaction  between  the 
secondary  vortex  and  the  leading-edge  shear  layer  generates  a  K-H  type  vortex.  As  this  K-H  type 
vortex  grows,  the  induced  flow  pushes  the  secondary  vortex  away  form  the  wall,  and  ultimately 
leads  to  the  shedding  of  the  B-family  vortex.  The  K-H  type  vortex  grows  in  size  as  the  secondary 
vortex  shows  up  again  near  the  wall.  The  induced  flow  pushes  the  K-H  type  vortex  away  form  the 
wall  and  leads  to  the  shedding  of  the  A-family  vortex.  So  the  A-family  vortex  originates  from  the 
Kelvin-Helmholtz  instability  of  shear  flow  near  the  leading-edge.  The  B-family  vortex  originates 
from  the  secondary  vortex.  The  period  of  vortex  shedding  is  between  OASL/Uoa  and  0.98L/Uoo ■ 
The  scale  of  the  K-H  type  leading-edge  vortex  and  the  secondary  vortex  is  about  0.005T. 

The  interpretation  of  the  above  phenomena  is  based  on  the  Kelvin-Helmholtz  instability  of 
cross-sectional  two-dimensional  flow.  Considering  many  cross-sections  simultaneously,  the  period 
of  vortex  shedding  is  the  same,  there  is  only  phase  difference  between  one  cross-section  and  the 
other.  From  a  three-dimensional  point  of  view,  the  A-  and  B-family  vortices  become  vortex  tubes, 
which  are  oblique  to  the  axial  direction. 
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3.4  History  of  Our  DNS/LES  Work 


Our  DNS  work  was  initiated  in  1990  by  NASA  Langley  research  grants,  Multilevel  Adaptive  Meth¬ 
ods  for  Flow  in  Transition,  grant  number  NASl-19016,  NAS1-19312,  NAG-1-1537.  The  purpose  is 
to  develop  a  multigrid  DNS  code  for  flow  transition.  The  code  is  mainly  for  incompressible  flow. 
We  started  to  work  for  compressible  flow  transition  and  turbulent  flow  in  1994  when  we  received 
AFOSR  support.  Since  then,  we  have  developed  efficient  DNS/LES  codes  for  both  incompressible 
and  compressible  flow.  We  have  use  both  DNS  and  LES  for  the  whole  process  of  flow  transition 
on  3-D  smooth  and  rough  flat  plates,  2-D  airfoils  and  3-D  swept-wings  (Liu  et  al,  1991a,  1991b, 
1992,  1993a,  1993b,  1993c,  1994a,  1994b,  1995a,  1995b,  1996a,  1996b,  1996e,  1997a,  1997b,  1997c, 
1997d;  Zhao  et  al,  1997;  Shan  et  al,  1999;  Jiang  et  al,  1999a,  1999b).  Some  of  these  computational 
results  are  well  validated. 


We  have  form  a  strong  DNS/LES  team  with  experts  in  grid  generation,  numerical  scheme,  flow 
solver,  turbulence  modeling,  and  visualization,  which  consists  of  1  faculty,  two  post  doctors,  and 
two  PhD  students.  The  AFOSR  grant  supports  faculty  and  post  doctors  while  Louisiana  Tech 
supports  two  PhD  students. 

The  features  of  DNS  research  by  the  Louisiana  Tech  Team  include  the  following: 

•  The  whole  process  of  flow  transition  including  receptivity,  linear  growth,  non-linear  instability, 
breakdown,  and  transition  to  turbulence. 

•  Detailed  simulation  of  flow  separation,  wakes,  interaction  between  separation  and  wakes,  noise 
generation  by  T-S  wave  and  wakes. 

•  General  geometry  including  2-D  and  3-D  airfoils  with  different  attack  angles. 

•  Medium  Reynolds  number  up  to  106. 

•  All  speeds,  including  incompressible,  subsonic,  and  supersonic  flows. 


4  Other  Supporting  Information 

4.1  Institutional  Description 

Louisiana  Tech  University  is  a  comprehensive  public  university  committed  to  quality  in  teaching, 
research,  creative  activity,  and  public  service.  Today,  Louisiana  Tech  has  over  10,000  students. 
Integral  to  the  purpose  of  the  University  is  its  expanding  commitment  to  graduate  education. 
Recent  additions  of  two  PhD  programs  and  efforts  to  form  internationally  competitive  research 
centers  are  strong  evidence  of  this  expanding  commitment  to  world  class  research  and  graduate 
education. 

As  a  university  with  a  rich  engineering  heritage,  Louisiana  Tech  has  a  special  responsibility  to 
integrate  advanced  technology  into  teaching  and  learning.  At  Tech,  advanced  technology  supports 
quality  teaching,  research,  and  service.  The  university  is  committed  to  providing  its  students  with 
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advanced  technological  skills  that  help  to  ensure  their  success  in  the  University  and  in  the  wider 
surrounding  community. 

The  College  of  Engineering  and  Science  (COES)  at  Louisiana  Tech  consists  of  Biomedical  En¬ 
gineering,  Chemical  Engineering,  Chemistry,  Civil  Engineering  and  Geoscience,  Computer  Science, 
Electrical  Engineering,  Mechanical  Engineering,  Mathematics  and  Statistics,  Physics,  and  Indus¬ 
trial  Engineering.  All  programs  offer  the  Master  degree.  COES  has  also  four  doctoral  programs, 
including  Ph.D.  in  Applied  Computational  Analysis  and  Modeling  (AC AM),  Ph.D.  in  Biomedical 
Engineering,  Ph.D.  in  Engineering,  and  Doctor  of  Engineering.  The  ACAM  curriculum  is  an  inter¬ 
disciplinary  doctoral  degree  program  administered  by  the  Graduate  School,  with  participation  from 
the  College  of  Engineering  and  Science  (including  Computer  Science,  Mathematics  and  Statistics). 
The  program  is  intended  to  produce  professionals  with  a  firm  grasp  of  the  fundamentals  of  math¬ 
ematical  modeling  who  also  have  the  expertise  to  implement,  analyze  and  evaluate  such  models 
using  state-of-the-art  computing  environments  and  advanced  visual  data  analysis  techniques.  The 
project  team  includes  a  number  of  ACAM  faculty  and  students. 

The  Center  for  Numerical  Simulation  and  Modeling  is  a  nationally  and  internationally  recog¬ 
nized  research  group  for  its  efforts  in  use  of  direct  numerical  simulation  (DNS)  and  large  eddy  sim¬ 
ulation  (LES)  techniques  with  multigrid  refinement  in  analysis  of  three-dimensional  turbulent  and 
transitional  flows.  They  are  one  of  the  major  research  centers  in  the  nation  to  conduct  DNS/LES 
for  complex  geometries. 

4.2  Maintenance  of  Existing  Equipment 

We  purchased  the  SGI  Origin  2000  wth  16  CPUs  and  4  GB  memory  by  an  AFOSR  grant  and 
Louisiana  Tech  matching  fund.  We  have  a  three-year  free  maintenance  contract  with  SGI  who 
provides  all  software  and  on-site  hardware  support  free  for  three  years,  1998-2001.  CNSM  is  in 
charge  to  manage  the  system  and  the  University  provides  a  1/4  technician  to  help  maintain  the 
system.  After  using  it  for  one  year,  we  found  the  system  is  well  maintained  and  managed.  We  only 
had  a  very  few  interruptions  because  of  the  defect  of  some  parts  and  SGI  fixed  it  very  quickly.  It 
is  clearly  shown  we  have  ability  to  maintain  the  upgraded  system  and  the  new  ImmersaDesk.  La 
Tech  has  got  a  new  three-year  free  maintenance  contract  with  SGI  for  the  new  upgraded  system. 

» 

4.3  Estimated  Life  of  the  Equipment 

Usually,  a  new  advanced  computer  could  be  thought  of  as  an  advanced  machine  for  at  least  three 
years,  and  will  be  considered  useful  for  another  5  years.  Therefore,  the  SGI  Origin  2000  can  be 
used  for  the  next  5  years.  The  ImmersaDeskis  estimated  to  be  used  for  the  next  5-8  years  before 
the  industry  develops  new  advanced  and  inexpensive  virtual  reality  system. 
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